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Related Application 

"^^e subject matter of this application is related to the subject matter in a 
co-pendina non-provisional application by the same inventor as the instant 
application and filed on the same day as the instant application entitled, 
"Apparatus far Assisting Video Compression in a Computer System," having 
serial number koBE_ASSIGNED, and filing date TO BE ASSIGNED (Attorney 



BACKGROUND 



Field of the Invention 

The present invention relates compressing video data, and more 
specifically to a method that provides assistance to a computer system in 
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compressing a stream of video data on-the-fly, as the video data streams into the 
computer system. 

Related Art 

As video data is increasingly used in computer systems in applications 
such as video conferencing and video recording, computer systems often cannot 
keep pace with the computational requirements of video data. Video data streams 
typically have extremely large bandwidth requires that can tax the capabilities of 
even the most high-speed processor to compress the video data for storage, or for 
transmission across a computer network or a telephone system. This compression 
is typically performed by a central processing unit (CPU) in a computer system 
with a resulting loss in image clarity due to the failure of the CPU to keep pace 
"witiVthe-v^ scenes, having many elements that are in motion 

represent the greatest challenge because they place a tremendou^'Buraen-oirthe — 
CPU during the compression and data transfer processes. 

A time-consuming step in the compression of video data is to compute 
differences between successive video frames. A CPU typically computes a 
difference frame by reading a current video frame into memory and computing the 
difference between the current video frame and a previous video frame, which 
was previously stored into a memory in the computer system. Computing the 
difference typirnlly invnhr-r pn TiiTiiiini im onrliniyp-nfl nppr ation betw een the 
current video frame and the previous video frame. In general, any function that 
effectively represents the difference between two successive video frames can be 
used with only minor modifications to the related compression algorithm. Hence, 
a large number of possible functions can be used to compute the difference 
between successive video frames. 



2 

Attorney Docket No. MEI-97-01386.01 Inventor: Dean A. Klein 

ARPC:\MY DOCUMENTS\MICRON ELECTRONICS. INOMEI-97-01 386.0 1VMEI-97-0 1386.01 APPLICATI0N.DOC 




What is needed is an apparatus or a method for off-loading the time- 
consuming task of computing the difference between successive frames of video 
data from the CPU of a computing. 



SUMMARY 

One embodiment of the present invention provides a method that 
facilitates compression of video data in a computer system by performing the 
time-consuming task of computing the difference between successive frames of 
video data independently from the central processing unit. This frees the often- 
overburdened central processing unit from performing this time-consuming 
compression operation and can thereby improve the handling of video data. Thus, 
one embodiment of the present invention can be characterized as a method for 
compressing video-data^ This method includes receiving a 

stream of data from a current video frame in the computer system. It alsolHelxtdes" 
computing a difference frame from the current video frame and a previous video 
frame "on-the-fly" as the current video frame streams into the computer system. 
The method additionally includes storing the difference frame in a memory in the 
computer system. 

Anotherembodm of the present invention includes storing the current 

e in the memory. In a variation on this embodiment,, thecryrent video 




frame is written over a previous vie 

In another embodiment of the present invention, computing the difference 
frame includes performing an-exclagiye- OR operationbetween the curren t video 
frame and the previ ous video fra rng. In another embodiment, computing the 
difference frame includes computing a difference between a block of data from 



the current video frame and a block of data from the previous video frame. 
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In another embodiment of the present invention, storing the difference 
frame in the memory includes storing the difference frame irUhememory using 
block transfers. 

Another embodiment of the present invention includes compressing-the^ 
video data using the difference frame to produce compressed video data. 

Another embodiment of the present invention includes performing color 
space conversion on the video data. Yet another embodiment includes using the 
video data in compressed form in a video teleconferencing system. A further 
embodiment includes storing instructions and data for the computer system in the 
memory. — 



In another embodiment of the present invention, computing the difference 
ame includes computing the difference frame in a core logic chip within the 
gute rsystem. In ano ther embodiment, computing the difference frame 

includes computing the difference frame in circuitry outsideof a~central 

processing unit in the computer system. 




DESCRIPTION OF THE FIGURES 

FIG. 1 illustrates a computer system including a graphics controller with a 
difference engine in accordance with an embodiment of the present invention. 
FIG. 2 illustrates a computer system-including a graphics controller 

mpnrpnr a tft/i miM w i j ■ iinit-in nnr^rHq nrf - y /ith another embodiment of the 

present invention. 

FIG. 3 illustrates the internal structure of a portion of the graphics 
controller that computes the difference between successive video frames in 
accordance with an embodiment of the present invention. 

FIG. 4 is a block diagram illustrating a method for compressing video data 
in a computer system in accordance with an embodiment of the present invention. 
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A. 



DEFINITIONS 

Color space conversion unit - circuitry that maps one set of color values to 
another set of color values. 

Computing on-the-flv - performing a computational operation on data 
streams through a computer system. 

( ^Core logic unit - circuitry within a computer system that interfaces^ 
jiroces^ 



Difference engine - circuitry that computes a difference function between 
successive video frames. This difference function may be an exclusive-OR 
operation. 



-DETAILED DESCRIPTION OF THE INVENTION 



The following description is presented to enable any person sJaiied'urtiie- 
art to make and use the invention, and is provided in the context of a particular 
application and its requirements. Various modifications to the disclosed 
embodiments will be readily apparent to those skilled in the art, and the general 
principles defined herein may be applied to other embodiments and applications 
without departing from the spirit and scope of the present invention. Thus, the 
pres ent invention is not intendedlo^BFliniited-to-the embodimentsshownjuit is 
to be accorded thr rnrlnt ~rnpr rftfl ~i7li nl innth'thr pp- wr iip1fff? Qr>rl feature 
disclosed herein. 



Description of a First Embodiment of the Computer System 

FIG. 1 illustrates a computer system including a graphics controller with a 
difference engine 106 in accordance with an embodiment of the present invention. 
The embodiment illustrated in FIG. 1 includes central processing unit (CPU) 120, 
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which is coupled through north bridge 1 18 to memory 122 and bus 1 16. CPU 120 
may be any type of central processing unit that can be used in a computer system. 
This includes, but is not limited to, a microprocessor CPU, a mainframe CPU and 
a device controller CPU. Northbrid ge 1 1 8 fo rms.part.o lthe "core knac" for the 
computer system . This core logic ties together and coordinates operations of 
components in the computer system. Memory 122 can be any type of 
semiconductor memory that can be used in a computer system. Bus 1 16 can be 
any type of computer system bus. In one embodiment, bus 116 includes a PCI 
bus. 

Bus 1 16 is also coupled to graphics controller 106, which includes a 
difference engine. In this embodiment, graphics controller 106 includes circuitry 
to perform a difference operation between successive video frames. Graphics 
cor-tr oller 106 is also coup led to memory 108 and video unit 102. Graphics 

controller 106 additionally produces video output 1 14, wHiclTteeas"into-a — ■ 

computer system monitor. 

Memory 108 may be any type of semiconductor memory that may be used 
in a computer system. In one embodiment of the present invention, memory 108 
is a dedicated graphics memory for graphics controller 106, which is separate 
from memory 122. In another embodiment, memory 108 and memory 122 are 
part of the same memory. In the illustrated embodiment, memory 108 includes an 

arpa tnr gtnrintx imm^llTflTI lm.1. nHntnl 1fl nnH^ n mn fcnstoring XOR vid eo 

data 112. In one embodiment, the area for storing unmodified video data 110 
stores a previous frame of unmodified video, and the area for storing XOR video 
data 1 12 stores a difference frame containing the exclusive-OR of a current frame 
and the previous frame. Other embodiments of the present invention may use 
other difference functions besides exclusive-OR. 
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Video unit 102 receives video input 100 in analog form and converts it to 
digital form. In the illustrated embodiment, video unit 102 receives video input 
100 in either PAL or NTSC format, and produces digital video data in YUV 
format 104. Video unit 102 may include the BT829 chip produced by Rockwell 
Semiconductor Systems, Inc. of Newport Beach, California. Alternatively, the 
Rock well BT848 parUnay^e used to transfer data across a computer syst em bus 
-into-system-memor y, or into at video controller's memory. (In some embodiments, 
these may be the same memory). Additionally, video data may be received from 
external sources through serial buses that can stream video data into system 
memory, usually by transferring data across bus 116. These serial buses may 
include the USB or the IEEE 1 394 bus. 

The embodiment illustrated in FIG. 1 operates as follows. Video input 
1 OQ^treams-into^ideo unit 1 02. which converts video input 100 into digital YUV 



data 104. YUV data 104 feeds into graphics controller 106, which produces video 
output 1 14 for display on a computer system monitor. Graphics controller 106 
additionally stores unmodified video data into unmodified video data 1 10 within 
memory 108. Graphics controller 106 also computes the difference between a 
current video frame and a previous video frame and stores this difference- - 



infb^^ difference information 

isused by CPU 120 to complete the compression process for the video data 
^stream 

Description of a Second Embodiment 

" ""TIG. 2 illustrates a computer system including a graphics controller 



incorporated intd^a^core logic unit200 inN^ccordance witii^iotfierembodiment of 



the present inventiSnnThis embodiment is simi lar to the embodiment illustrated 



C in FIG. 1, ex cept that graphics controller 106 and north bridge 1 1 8 from FIG. 1 
\ ^ ~ jT~~ ^ 
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are combined into a single coreJogic.unitwith graphics controller 200. 




Additionally, memory 108 and memory 122 from FIG. 1 are combined into a 
single memory 122 in FIG. 2. 

In the embodiment illustrated in FIG. 2, core logic unit 200 includes 
circuitry to compute the difference between successive video frames as well as 
circuitry to perform other graphics controller functions. 

The embodiment illustrated in FIG. 2 operates in the same way as the 
embodiment illustrated in FIG. 1, except that in FIG. 2, unmodified video data 
1 10 and XOR video data 1 12 are not stored in a separate graphics memory 108, 
but are rather stored in the system memory 122. Hence, CPU 120 does not have 
to reach out across bus 1 16 to retrieve XOR video data 1 12 from a separate 
graphics memory to complete the compression process. It merely has to retrieve 



data the XOR-videG-dataJJl^Gmthe^ystem memory. 



Description of Internal Structure of Graphics Controller 

FIG. 3 illustrates the internal structure for a portion of a graphics controller 
that computes the difference between successive video frames in accordance with 
an embodiment of the present invention. The circuitry illustrated in FIG. 3 can 
-e xist in either gr aphics contr oller 106 from FIG. 1 or in core logic unit 200 from 



JEIG...2. The circ uitry illustrated in FIG. 3 includes YUV data input 104, which 
feeds through color space rnirrn inn mnrlnlr VlT Tlih inuiluli may pnf^rm 
color re-mapping on YUV data 104. The output of color space conversion 
module 302 feeds into video input buffer 304. From video input buffer 304, the 
video data feeds either into XOR unit 308 and multiplexer (MUX) 312. XOR unit 
308 takes another input from previous frame buffer 306 and generates an output, 
which feeds into result buffer 310. Data from result buffer 3 1 0 feeds through 
MUX 3 12 and I/O buffers 316 into memory 108. MUX 312 takes another input 

8 



Attorney Docket No. MEI-97-01386.01 Inventor: Dean A. Klein 

ARPC:\MY DOCUMENTSVMICRON ELECTRONICS. INC\MEI-97-01386.01\MEI-97-01386.01 APPLICATION. DOC 



from other write circuits 314. This allows data to be written to memory 122 from 
other sources. Data read from memory 122 feeds into previous frame buffer 306, 
and then into XOR unit 308. Alternatively, data read from memory 122 may feed 
into other read circuits 315, allowing data to be read from memory 122 by other 
sources. Data read from memory 122 may also pass through serializer 330, color 
lookup table 332 and digital-to-analog converter 334 before becoming video 
output 1 14 to a monitor. Serializer 330 converts data read from memory 122 into 
a serial bitstream. This bitstream is modified in color lookup table 332, and is 
ultimately converted into analog form in digital-to-analog converter 334. 

The circuitry illustrated in FIG. 3 operates as follows. Video data in YUV 
form 104 from video unit 102 streams into video input buffer 304 through color 
space conversion module 302. From video input buffer 304, this video data feeds 
-thxaug h.MUX 3 12 and I/O buffers 316 into unmodified video data 110 within 
memory 122. At the same time, data for a previous frame from unmodified"vide'o 
data 1 10 in memory 122 feeds into previous frame buffer 306 through I/O buffer 
316. From previous frame buffer 306, this data feeds into XOR unit 308. XOR 
unit 308 computes the difference between data from the previous frame, stored in 
previous frame buffer 306, and data from the current frame, stored in video input 
buffer 304. The output of XOR unit 308 feeds into result buffer 310. From result 
buffer 3 1 9, this data feeds through MUX 3 1 2 and I/O buffers 3 1 6 into an area for 

gtnrinp Yf IK viHpo rl »h* II ) w i l lT i TTTiT iiy-I^O P-Pl-I-] O f) ffr^ ffrjo 

difference information to compress the video data. 

^XlD 111 one embodiment, data is processed a block at a time through XOR unit 
08^ wherein a block includes multiple words of data. 




BTfhe embodiment illustrated in FIG. 3, data for the current frame is 
overwritten over data for the previous frame as the data for the previous frame is 
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retrieved into previous frame buffer 306. This allows the frame data to be stored 
in one location without using "ping pong" buffers. 

The embodiment illustrated in FIG. 3 also includes registers for storing 
address A 322 and address B 324. Address A 322 and address B 324 are pointers 
into memory 122 for keeping track of data within unmodified video data 1 10 and 
XOR video data 112 within memory 122. 

Description of Method for Compressing Video Data 

, FIG. 4 is a flow chart illustrating a method for compressing video data in a 
computer system in accordance with an embodiment of the present invention. 
This flow chart is divided into two columns. The column on the left-hand-side 
represents operations of the computational unit, and the column on the right-hand- 
-side-renr eaentsjo perations of the mem ory system. In this embodiment, the system 
starts in state 400. From state 400, the computational proceeds state 402. In state" 
402, the computational unit receives a stream of data from a current video frame 
from a video source. The computational unit next proceeds to state 404. In state 
404, the computational unit performs a color space conversion on the video data. 
The computational unit next proceeds to state 406. In state 406, the 
computational unit computes a difference frame from a current video frame and a 
previous video frame received from the memory system "on-the-fly" as the 
mrrmt virlrn frnmr Trmrm iti1 Ti~TITi i~i imjT ii ln i j i lnm Tn^ i ^ 
difference computation takes place without inter vention by the C PIL1 20. Jhe 
computational unit next proceeds to state 412. In state 412, the computational 
unit produces compressed video data using the difference frame. The 
computational unit then loops back around to state 402 to process more video 
data. 
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From state 400, the memory system proceeds to state 422. In state 422, 
the memory system fetches a block of data from the previous frame. This block of 
data is forwarded to the computational unit for use in state 406. The memory 
system next proceeds to state 424, in which the memory system stores the current 
video frame — received from the computational unit in state 404 - into memory 
122. The memory system next proceeds at state 426. In state 426, the memory 
system stores the difference frame into memory 122. The memory system then 
loops back around to state 422 to process more video data. 

The foregoing descriptions of embodiments of the invention have been 
presented for purposes of illustration and description only. They are not intended 
to be exhaustive or to limit the invention to the forms disclosed. Obviously, many 
modifications and variations will be apparent to practitioners skilled in the art. 
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